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Abstract 

We consider nonequilibrium systems with complex dynamics in 
stationary states with large fluctuations of intensive quantities (e.g. 
the temperature, chemical potential or energy dissipation) on long 
time scales. Depending on the statistical properties of the fluctuations, 
we obtain different effective statistical mechanical descriptions. Tsallis 
statistics follows from a ^-distribution of an intensive variable, but 
other classes of generalized statistics are obtained as well. We show 
that for small variance of the fluctuations all these different statistics 
behave in a universal way. 



Einstein never accepted Boltzmann's principle S = klogW, because he 
argued that the statistics (W) of a system should follow from its dynamics 
and, in principle, could not be postulated a priori [jl], Remarkably, the 
Boltzmann-Gibbs (BG) statistics works perfectly for classical systems with 
short range forces and relatively simple dynamics in equilibrium. A possi- 
ble consequence of Einstein's criticism is that for systems with sufficiently 
complex dynamics, other than BG statistics might be appropriate. Such a 
statistics has indeed been proposed by Tsallis and has been observed in 
various complex systems PI— 1|17|| . For these types of systems the formalism of 
nonextensive statistical mechanics [|19|, is a useful theoretical concept, in 
the sense that a more general Boltzmann factor is introduced which depends 
on an entropic index q and which, for q = 1, reduces to the ordinary Boltz- 
mann factor. Applications of the formalism have been mainly reported for 
multifractal systems, systems with long-range interactions and nonequilib- 
rium systems with a stationary state. Several types of generalized stochastic 
dynamics have been recently constructed for which Tsallis statistics can be 
proved rigorously j|, |], 0- Physical applications include 2-d and 3-d tur- 



bulence |[7||-||14||, momentum spectra of hadronic particles produced in e + e~ 
annihilation experiments |15|, 113] , the statistics of cosmic rays P7| |, and many 
other phenomena. 

In this letter we will quite generally deal with nonequilibrium systems 
with a long-term stationary state that possess a spatio-temporally fluctuat- 
ing intensive quantity. We will show that after averaging over the fluctuations 
one can obtain as an effective description not only Tsallis statistics but an 
infinite set of more general statistics, which we will call 'superstatistics'. We 
will consider several concrete examples. A parameter q can be defined for 
all these new statistics and given a physical interpretation. For q — 1 all 
superstatistics reduce to the Boltzmann factor e~^° E of ordinary statistical 
mechanics. One of our main results is universality for small amplitudes of the 
fluctuations. If the variance of the fluctuations is small, then the first-order 
corrections to the ordinary Boltzmann factor are the same for all superstatis- 
tics (i.e. those of Tsallis statistics). On the other hand, for large variances 
quite different behaviour from Tsallis statistics can be generated. We calcu- 
late the higher-order correction terms of various examples of superstatistics. 

Experimental evidence for superstatistics that is nearly Tsallis but has 
tiny corrections beyond Tsallis has very recently been provided by Jung 
and Swinney |[23|| , by careful analysis of velocity fluctuations in a turbulent 
Taylor- Couette flow. Moreover, experimental studies from fusion plasma 
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physics provide possible evidence for non-Tsallis superstatistics based on F- 
distributions p4j. All this illustrates the need for a more general approach 



towards generalized statistics for complex dynamical systems. 

Let us now outline the theory Consider a driven nonequilibrium system 
that is composed of regions that exhibit spatio-temporal fluctuations of an 
intensive quantity. This could be the inverse temperature (3, or equally well 
the pressure, chemical potential, or the energy dissipation rate in a turbulent 



fluid H [□], jl2j[ . We will select the temperature here as our fluctuating 
quantity but it could be anything of the above. We note that even the 
fluctuation theory of Onsager and Machlup does not treat this case and 



is restricted to fluctuations of extensive thermodynamic variables [jig]. We 
consider a nonequilibrium steady state of macroscopic system, made up of 
many smaller cells that are temporarily in local equilibrium. Within each 
cell, f3 is approximately constant. Each cell is large enough to obey statistical 
mechanics, but has a different (3 assigned to it, according to a probability 
density /(/?). We assume that the local temperatures in the various cells 
change on a long time scale T. This time scale T is much larger than the 
relaxation time that the single cells need to reach local equilibrium. It is 
clear that our model is a suitable approximation for a continuously varying 
temperature field that has spatial correlation length of the order of the cell 
size L and a temporal correlation length T. 

A Brownian test particle moves for a while in a certain cell with a given 
temperature, then moves to the next cell, and so on. Its velocity v obeys 

v = -jv + aL(t), (1) 

where L(t) is Gaussian white noise. The inverse temperature of each cell is 
related to the parameters 7 and a by (3 = 'j/cr 2 . However, unlike ordinary 
Brownian motion, the parameter /3 is not constant but changes temporally 
on the time scale T and spatially on the scale L. These changes are ulti- 
mately produced by the very complex dynamics of the environment of the 
Brownian particle. It has been proved by one of us || that after averag- 
ing over the fluctuating (3 this simple generalized Langevin model generates 
Tsallis statistics for v if (3 is a x 2 -distributed random variable. Moreover, the 
obtained distributions for v were shown to fit quite precisely distributions 
of longitudinal velocity differences as measured in turbulent Taylor-Couette 
flows H jlOfl , as well as measurements in Lagrangian turbulence [0, jl3jl . 



Let us here generalize this approach to general distributions f(/3) and 
general (effective) Hamiltonians. In the long-term run (t » T), the station- 
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ary probability density of our nonequilibrium system arises out of Boltzmann 
factors e~ l3E associated with the cells that are averaged over the various fluc- 
tuating inverse temperatures (3. If E is the energy of a microstate associated 
with each cell, we may write 



where B is a kind of effective Boltzmann factor for our nonequilibrium sys- 
tem, the superstatistics of the system. In a sense, it represents the statistics of 
the statistics (e~ /3E ) of the cells of the system. B(E) may significantly differ 
from the ordinary Boltzmann factor, which is recovered for f(/3) = 5{(3 — (3q). 
For the above simple example of a Brownian test particle of mass 1 one has 
E = \v 2 '', so that the long-term stationary state consists of a superposition of 
Gaussian distributions e~ f3E that are weighted with the probability density 
f(0) to observe a certain (3. But our consideration in the following applies to 
arbitrary energies E associated with the cells, not only E = |t> 2 . The central 
hypothesis of our paper is that generalized Boltzmann factors of the form (0) 
are physically relevant for large classes of dynamically complex systems with 
fluctuations. 

One immediately recognizes that the generalized Boltzmann factor of su- 
perstatistics is given by the Laplace transform of the probability density 
f{(3). Although there are infinitely many possibilities, certain criteria must 
be fulfilled which significantly reduce the number of physically relevant cases: 

1. f(/3) cannot be any function but must be a normalized probability den- 
sity. It may, in fact, be a physically relevant density from statistics, 
say Gaussian, uniform, chi-squared, lognormal, but also other, as yet 
unidentified, distributions could be considered if the underlying dynam- 
ics is sufficiently complex. 

2. The new statistics must be normalizable, i.e. the integral J °° B(E)dE 
must exist, or in general the integral / °° p(E)B(E)dE, where p(E) is 
the density of states. 

3. The new statistics should reduce to BG-statistics if there are no fluctu- 
ations of intensive quantities at all. 

We will now consider several examples of superstatistics (later we will 
see what is universal to all of them). The distribution f{(3) is ultimately 
determined by the invariant measure of the underlying dynamical system 
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and a priori unknown. Gaussian /^-fluctuations would generate one of the 
simplest f(/3), but these types of models are unphysical since they allow for 
negative /3 with some non-zero probability. Instead, we need distributions 
where the random variable j3 is always positive. 



Uniform distribution 

As a very simple model where everything can be calculated analytically let 
us first consider a uniform distribution of (5 on some interval [a, a + b], i.e. 

f(P) = I (3) 

for < a < (3 < a + 6, whereas f((3) = elsewhere. The mean of this 
distribution is 

(3o = a+ b - (4) 

and for the variance one obtains a 2 = {/3 2 ) — /3 2 = b 2 /12. The superstatistics 
of this model follows from the generalized Boltzmann factor 

B = J™ e^ E f{(3)d(3 = -L (e-Vh-hW - e -(^\b)E^ (5) 

This is normalizable for any E > 0. Hence this is a reasonable model of 
superstatistics. For small bE one obtains, by series expansion of e~2 hE \ 

B = e~ l3 ° E (l + —b 2 E 2 H ^—b A E A + ...) (6) 

v 24 1920 ; V ; 

Clearly, for b — > ordinary statistical mechanics is recovered. 



2-level distribution 

Suppose the subsystems can switch between two different discrete values of 
the temperature, each with equal probability. A physical example might be 
a Brownian particle that can switch between two different states with differ- 
ent friction constants, or two different chemical potentials. The probability 
density is given by 

f(P) = ^(a) + 1 -5(a + b). (7) 
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The average of (3 is again given by 

Po = a + b - (8) 

and for the variance one obtains a 2 = ((3 2 ) — f3 2 = b 2 /4. The generalized 
Boltzmann factor becomes 



B = / e^ E f((3)d(3 = e~^ E - e^ E + e^ bE . (9) 



o 

This is normalizable for any E > 0. For small bE one obtains 

B = e - fhE (l + -b 2 E 2 + —b 4 E 4 + ...). (10) 
v 8 384 ; v ; 

Gamma-distribution 

The assumption of a Gamma (or x 2 -) distributed inverse temperature (3 leads 
to Tsallis statistics, so far the most relevant example of superstatistics. We 
may write the Gamma distribution as 

13'-'-' 



where c > and b > are parameters. The number 2c can be interpreted 
as the effective number of degrees of freedom contributing to the fluctuating 
p. The average of (3 is flo = (3f(/3)d/3 = be and for the variance of (3 one 
obtains a 2 = b 2 c. 

The Gamma distribution naturally arises if n = 2c independent Gaussian 
random variables Xk with average are squared and added. If we write 



/? = E X ' ( 12 ) 

k=l 

then this f3 is Gamma distributed with density (JTTT) . The average of f3 is of 
course given by n times the variance of the Gaussian random variables X^. 
In this sense the Gamma distribution arises very naturally for a fluctuating 
environment with a finite number n of degrees of freedom. 

The integration over f3 yields the generalized Boltzmann factor 

/>oo 

B= / e-P E f((3)d[3=(l + bE)- c , (13) 
Jo 
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i.e. the generalized Boltzmann factor (1 + (q — 1)(3qE)~~ of nonextensive 
statistical mechanics || [05], ^] if we identify c = and be = (3q. It is 
normalizable for c > 1 (if p(E) = 1). 

We may also write B = exp {— clog(l + bE)} and expand the logarithm 
for small bE. The result can be written in the form 

B = e"^(l + \{q - 1)(3 2 E 2 - ±( g - l) 2 /3 3 £ 3 + ...) (14) 

where q is the entropic index of nonextensive statistical mechanics. 



Log-normal distribution 

The log-normal distribution 



/( ^^ exp i-^ (15) 



yields yet another possible superstatistics (see also |ST| for a related tur- 
bulence model); m and s are parameters. The average (5q of the above log- 
normal distribution is given by /3 = m^pw and the variance by a 2 = m 2 w(w— 
1), where w := e s . The generalized Boltzmann factor B = J °° f((3)e~ l3E df3 
cannot be evaluated in closed form, but in leading order we obtain for small 
variance of the inverse temperature fluctuations 

1 1 3 

B = e- p ° E {l + -m 2 w(w - l)E 2 - -m 3 w^ (w 3 - 3w + 2)E 3 + ...). (16) 

2 6 



F-distribution 

The last example we want to consider is that of a (3 G [0, oo] distributed 



according to the F-distribution [[22 



f{P) 



T({v + w)/2) fbv 



v/2 



T(v/2)T(w/2) \ w J (1 + ^)(«+« I )/2 



(17) 



Here w and v are positive integers and b > is a parameter. We note that for 
v = 2 we obtain a Tsallis distribution. However, this is a Tsallis distribution 
in /3-space, not in _E-space as in eq. flTBp. 
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The average of (3 is given by 



A) = 77 ~~~^\ (18) 

b[w — 2) 



and the variance by 



2w 2 (v + w-2) 



° b 2 v(w-2) 2 (w-A)' (19) 

The Laplace transform cannot be obtained in closed form, but for small 
variance of the fluctuations we obtain the series expansion 

r>/ rp\ p -PoE A , w 2 (v+w-2) 2 
B[E) ~ e [ l + b 2 v(w-2) 2 (w-4) E 

Aw 3 (v + w- 2)(2v + w- 2) 3 



E* + ...). (20) 



3b 3 v 3 / 2 (w - 2f{w - 4)(iu - 6)' 

F-distribution in /?-space have also been recently studied by Sattin and Salas- 
nich [23], who point out possible applications in fusion plasma physics. 

While in general the large-i? behavior is different for all superstatistics 
(it strongly depends on the function /(/?)), we now show that the low-E" 
behavior is universal. We note that for the above five distribution functions 
the first-order corrections to the Boltzmann factor e~ /3 ° E in eqs. (^), (|TUD, 
([H|), (|16|), ( p0|) can all be written in a universal form. When expressing the 
generalized Boltzmann factor in terms of the average temperature (3q and the 
variance a 2 of the various probability densities f(/3), one always obtains the 
same result for small a, 

B = e- poE {l + \j 2 E 2 + 0(a 3 E 3 )), (21) 

where a is the standard deviation of the distribution f(/3). Thus in the 
limit of approaching ordinary statistics, the generalized Boltzmann factor of 
superstatistics has a universal quadratic correction term (1 + ^a 2 E 2 ). 

Let us now prove this universality. For any distribution f{(3) with average 
Po '■= (P) an d variance a 2 := (ft 2 ) — /3q we can write 

B = 



Po) r )E r ■ (22) 
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Here the coefficients of the powers E r are the r-th moments of the distribu- 
tion f{(3) about the mean, which can be expressed in terms of the ordinary 
moments as 

w-m=^( r A (23) 

3=0 ^ J / 

Due to the universality proved above, it now makes sense to define a 
universal parameter q for any superstatistics, not only for Tsallis statistics. 
By comparing eq. ( |HD and (pi]), we generally define a parameter q by the 
relation 

(q - = a 2 , (24) 

or equivalently 

<-w (25) 

For example, for the log-normal distribution we obtain from eq. (pS[) q = w 
and for the F-distribution q = 1 + 2 ^^~^ . The physical meaning of this 
generally defined parameter q is that y/q — 1 = is just the coefficient of 
variation of the distribution f(/3), defined by the ratio of standard deviation 
and mean. If there are no fluctations of (3 at all, we obtain q = 1 as required. 
For small aE the corrections to the ordinary Boltzmann factor e~ f3 ° E are 
universal and given by the factor (1 + (q — 1)(3qE 2 /2). 

Since for small aE all superstatistics are the same and given by Tsallis 
statistics, we also have a maximum entropy principle for the normalized 
Boltzmann factors of all our superstatistics in terms of the Tsallis entropies 



|3], [ilj] with an entropic index q given by eq. ( pq) . For sufficiently small 
variance of the fluctuations they all extremize the Tsallis entropies subject 
to given constraints, no matter what the precise form of f(/3) is. 

However, differences arise if aE is not small. Then there are many dif- 
ferent superstatistics described by different B(E), and the densities given by 
B(E) do not extremize the Tsallis entropies in general. Rather, as shown 
very recently by Tsallis and Souza P5fl , they extremize more general classes 
of entropy-like functions. The Boltzmann factor of the examples of super- 
statistics that we considered above, if expressed in terms of the universal 
parameters q and /?o, can be written as 

B{E) = e"^(l + \{q - l)^E 2 + g{q)^ + ...), (26) 
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where the function g(q) depends on the superstatistics chosen. We obtain 
g(q) = (uniform and 2 — level) (27) 

= --(g-1) 2 (Gamma) (28) 
3 

= - 3g + 2) (log - normal) (29) 

= _l (g-l)(5g-6) (F ^ = 4 ). (30) 
3 3 — g 

For sufficiently large variance a 2 or energy E one can distinguish between 
Tsallis statistics and other superstatistics by the third-order term g(q)P^E 3 , 
which describes the first significant differences between the various super- 
statistics and hence provides more information on the underlying complex 
dynamics. In the turbulence applications described theoretically in |J [11], |I2|| 
and experimentally in [10, [j, the fluctuating intensive quantity is related to 



the energy dissipation rate of the flow, and the fluctuations of this quan- 
tity are indeed large. Moreover, the energy E essentially corresponds to the 
square of local velocity differences in the fluid, and these are also measured 
up to very large values. Therefore these experiments can well provide precise 
information about the kind of superstatistics needed to describe the complex 
dynamics. 

An interesting question is what type of averaging process is the physically 
most relevant one for a generic system with intensive parameter fluctuations. 
We may either work with unnormalized Boltzmann factors e~^ E that are 
averaged over f3 and then finally normalize by doing the integration over 
all energy states E (type-A superstatistics), or we may work with locally 
normalized distributions p(E) = zjj3) e ~ l3E an d average those over all (3 (type- 
B superstatistics). Since in general the normalization constant Z depends 
on /3, the result will differ slightly. However, case B can be easily reduced 
to case A by replacing the distribution f(j3) by a new distribution f(f3) : = 
C 'Z (f3)~ l j '((3) , where C is a suitable normalization constant. In other words, 
type-B superstatistics with / is equivalent to type-A superstatistics with /. 
Our formula (|25 ) relating q and the variance of the f3 fluctuations is valid for 
both type-A and type-B superstatistics, just that all expectations (...) must 
be formed with either / (type-A) or / (type-B). For example, if E = \u 2 , 
then Z(f3) = ^/W/? and hence f((3) ~ (3 1/2 f((3). If f([3) is given by the 
T-distribution eq. (|TT|), then type-A superstatistics yields 5 = 1 + -, whereas 
type-B yields q = l + ^-j. 
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To summarize, in this letter we have introduced a class of generalized 
statistics, which we have called 'superstatistics'. Tsallis statistics is a special 
case of these superstatisics. The dynamical parameter q of eq. (p5| ) can be 
defined for all these new statistics. For small variance of the fluctuations we 
have shown that there is universal behavior of all superstatistics. For large 
variance there are differences which provide information on the underlying 
complex dynamics. In general, complex nonequilibrium problems may re- 
quire different types of superstatistics. Tsallis statistics is just one example 
of many possible new statistics. There is no a priori reason to expect that 
other superstatistics would not be present in nature, thus confirming the 
relevance of Einstein's remark. 
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